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We develop a new method for constructing "good" designs for 
computer experiments. The method derives its power from its basic 
structure that builds large designs using small designs. We specialize 
the method for the construction of orthogonal Latin hypercubes and 
obtain many results along the way. In terms of run sizes, the exis- 
tence problem of orthogonal Latin hypercubes is completely solved. 
We also present an explicit result showing how large orthogonal Latin 
hypercubes can be constructed using small orthogonal Latin hyper- 
cubes. Another appealing feature of our method is that it can easily 
be adapted to construct other designs; we examine how to make use 
of the method to construct nearly orthogonal and cascading Latin 
hypercubes. 

1. Introduction. Scientists are increasingly using experiments on com- 
puter simulators to help understand physical systems. Computer experi- 
ments differ from physical experiments in that the systems are usually de- 
terministic, and thus the response in computer experiments is unchanged if 
a design point is replicated. The lack of random error presents challenges to 
both the design and analysis of experiments [e.g., see Sacks et al. (1989)]. 

Similar to physical experiments, computer experiments are performed 
with a variety of goals in mind. Objectives include factor screening [Welch 
et al. (1992), Linkletter et al. (2006)], building an emulator of the simulator 
[Sacks et al. (1989)], optimization [Jones, Schonlau and Welch (1998)] and 
model calibration [Kennedy and O'Hagan (2001)]. Latin hypercube designs 
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[McKay, Beckman and Conover (1979)] are commonly used for computer 
experiments. These designs have the feature that when projected onto one 
dimension, the equally-spaced design points ensure that each of the input 
variables has all portions of its range represented. 

While constructing Latin hypercube designs is fairly easy, it is more chal- 
lenging to find these designs when optimality criteria are imposed. For details 
of optimality criteria, see Shewry and Wynn (1987), Morris and Mitchell 
(1995), Joseph and Hung (2008) and the references therein. In this article, 
we focus on the orthogonality of Latin hypercubes. Ye (1998), Steinberg 
and Lin (2006) and Cioppa and Lucas (2007) developed methods for con- 
structing orthogonal Latin hypercubes. These methods all have restrictions 
on the run size n. The approach of Ye (1998) and Cioppa and Lucas (2007) 
gives designs for n = 2 k or 2 k + 1, and the method of Steinberg and Lin 
(2006) provides designs for n = 2 2 where k > 2 is an integer. Practitioners 
would appreciate a methodology that can quickly produce designs with more 
flexible run sizes. 

In this article, a new construction is proposed for finding "good" Latin 
hypercube designs for computer experiments. The method is simple and 
uses small designs to construct larger designs with desirable properties. Our 
methodology is quite powerful insofar as it allows orthogonal Latin hyper- 
cubes to be constructed for any run size n where n ^ 4k + 2. When n = 4k + 2, 
we prove that an orthogonal Latin hypercube does not exist. Another im- 
portant feature of our method is that it can easily be adapted to construct 
nearly orthogonal Latin hypercubes and cascading Latin hypercubes [Hand- 
cock (1991)]. 

The article is outlined as follows. Section 2 introduces notation, presents 
a general method of construction and discusses how to obtain Latin hy- 
percubes based on this general structure. Section 3 devotes itself to the 
construction of orthogonal Latin hypercubes. Besides several general theo- 
retical results and many concrete examples, an existence result is also estab- 
lished here. In Section 4, we examine how the general method can be used 
to construct nearly orthogonal Latin hypercubes. We conclude the article 
with some remarks in Section 5. The proofs for some theoretical results are 
deferred to Appendix for a smooth flow of the main ideas and results. 

2. A general method of construction. Consider designs of n runs with 
m factors of s levels where 2 < s < n. Without loss of generality, the s levels 
are taken to be centered at zero and equally spaced. For odd s, the levels 
are taken as — (s — l)/2, . . . , —1, 0, 1, . . . , (s — l)/2, and for even s, they are 
-(s - l)/2, . . . , -1/2, 1/2, . . . , (s - l)/2. The levels, except for level in the 
case of odd s, are assumed to be equally replicated in each design column to 
ensure that linear main effects are all orthogonal to the grand mean. Such a 
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design is denoted by D(n,s m ) and can be represented by an n x m matrix 
D = (dij) with entries from the set of s levels as described above. In this 
notation, an m-factor Latin hypercube design is a D(n,s m ) with n = s. 

2.1. Construction method. Let A = (aij) niX m 1 be a matrix with entries 
<Hj =±1, B= (6ij)„ 2 xm 2 be a D(n 2 ,S2 12 ), C = (c;j) niXmi be a ^(nijS™ 1 ) 
and D = (dij) n2X m 2 be a matrix with entries dij = ±1. Let 7 be a real 
number. New designs are found using the following construction: 

(2.1) L = A®B + -yC®D, 

where the Kronecker product A <g> B is the n\U2 x m\m2 matrix, 



A®B 



a\\B awB ■■■ ai mi B 

Q2lB CL22B ■■■ Cl2 mi B 




.a ni iB a m 2B ■■■ a nimi B_ 

with ciijB itself being an n-2 x ni2 matrix. The resulting design L in (2.1) 
has n = n\U2 runs and m = m\m2 factors. 

The above construction has an interesting interpretation. As an illustra- 
tion, consider a simple case in which A = (1,1) T and C = (1/2, -1/2) T . 
Design L in (2.1) has a column, 

(2.2) 

\ h- 

2 

where b is a column of B and d is a column of D. Further let d = (d\, . . . , d n2 ) T . 
Since dj = ±1, the column (2.2) can be viewed as simultaneously shifting 
each level in b to the left and the right by 7/2. If we view 6 as a block of 
level settings, then we are shifting two identical blocks b, one to the left and 
the other to the right. We will show in Section 2.2 that with the appropriate 
choices of A, B, C, D and 7, the levels in each column of L in (2.1) are 
equally spaced and unreplicated, thus resulting in a Latin hypercube. 

Now consider all m columns of L under this simple case. Each one- 
dimensional block b becomes an m-dimensional stratum, B. Suppose D is a 
matrix of plus ones. Then the design points in S + 7D/2 can be obtained by 
shifting the entire stratum B to the right by 7/2. Similarly, the design points 
in B — 7-D/2 can be obtained by shifting the entire stratum B to the left 
by 7/2. In this case, closely clustered points in each stratum are expected. 
This feature can be utilized to construct cascading Latin hypercubes [Lin 
(2008)]. 

We shall see that the orthogonality or near orthogonality of L in (2.1) is 
determined by the orthogonality or near orthogonality of A, B, C and D, the 
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correlations between the columns in A and those in C, and the correlations 
between the columns in B and those in D. As a result, the method allows 
orthogonal and nearly orthogonal Latin hypercubes to be easily constructed. 

Vartak (1955) appears to be the first to use the Kronecker product sys- 
tematically to construct statistical experimental designs. In a recent work, 
Bingham, Sitter and Tang (2009) introduced a method for constructing a 
rich class of designs that are suitable for use in computer experiments. Their 
approach corresponds to 7 = in the general construction given in (2.1). 
The designs in that paper have many levels and are not Latin hypercubes 
in general. 

2.2. Latin hypercubes. The following result shows how to obtain Latin 
hypercubes from the construction in (2.1). 

Lemma 1. Let 7 = ni- Then design L in (2.1) is a Latin hypercube if: 

(i) both B and C are Latin hypercubes and 

(ii) at least one of the following two conditions is true: 

(a) A and C satisfy that for any i, if p and p' are such that c p i = 
£"p'ii then Opi — Op'i, 

(b) B and D satisfy that for any j , if q and q' are such that b q j = 
—bqij, then d q j =d q ij. 

The proof is given in the Appendix. Just in terms of constructing Latin 
hypercubes, Lemma 1 is not of much significance in itself as one can easily 
obtain a Latin hypercube simply by combining several permutations of the 
set of levels. The significance of Lemma 1 lies in the fact that it produces 
Latin hypercubes with the structure in (2.1) and thus provides a path to 
the construction of orthogonal and cascading Latin hypercubes. 

Condition (i) in Lemma 1 is not really a condition, and it simply tells 
us to choose B and C to be Latin hypercubes. In order for L to be a 
Latin hypercube, the only mild condition is that in (ii) of Lemma 1. Two 
situations where condition (ii) is obviously met are as follows: (a) C has a 
foldover structure in the sense that C = (Cq , —Cq) t , and A has the form 
A = (Aq , Aq ) t ; (/3) A or D is a matrix of all plus ones. Both situations are 
useful. Theorem 3 of Section 3.3 is derived under situation (a). Situation 
(f3) can be used for constructing cascading Latin hypercubes. We now give 
an example to illustrate Lemma 1. 

Example 1. Consider the construction of Latin hypercubes of 32 runs 
with 32 factors. We choose n\ = rrt\ = 2 and n% = mi = 16 so that n = 
n\H2 = 32 and m = m\mi = 32. To meet condition (ii) in Lemma 1, let A be 
a matrix of all plus ones. Now let 7 = n2 = 16 and D = (dij) be any 16 x 16 
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Table 1 

Design matrix of Bo in Example 1 



f-15 


5 


9 


-3 


7 


11 


-11 


7 


-9 


3 


-15 


5 


11 


-11 


7 


-7\ 


-13 


1 


1 


13 


-7 


-11 


11 


-7 


-1 


-13 


-13 


1 


13 


5 


5 


-3 


-11 


7 


-7 


-11 


13 


-1 


-1 


-13 


9 


-3 


15 


-5 


-5 


11 


-7 


7 


-9 


3 


-15 


5 


-13 


1 


1 


13 


1 


13 


13 


-1 


-13 


-5 


-5 


3 


-7 


-11 


11 


-7 


11 


-7 


7 


11 


5 


15 


-3 


-9 


-9 


3 


9 


11 


-5 


-15 


3 


9 


-11 


7 


-7 


-11 


13 


-1 


-1 


-13 


-1 


9 


11 


15 


-3 


-9 


-5 


-15 


1 


13 


13 


-1 


-5 


-15 


3 


9 


1 


7 


-11 


-11 


-1 


-13 


-13 


1 


-1 


-13 


-13 


1 


-13 


1 


1 


13 


9 


-9 


-9 


-15 


1 


13 


13 


-1 


-9 


3 


-15 


5 


11 


-7 


7 


11 


-7 


-7 


-15 


-9 


3 


9 


5 


15 


9 


-3 


15 


-5 


3 


9 


5 


15 


-15 


-13 


-13 


-13 


5 


15 


-3 


-9 


-3 


-9 


-5 


-15 


-11 


7 


-7 


-11 


15 


-3 


15 


9 


7 


11 


-11 


7 


3 


9 


5 


15 


-3 


-9 


-5 


-15 


7 


15 


13 


13 


9 


-3 


15 


-5 


-5 


-15 


3 


9 


-7 


-11 


11 


-7 


5 


13 


-3 


5 


11 


-7 


7 


11 


5 


15 


-3 


-9 


-15 


5 


9 


-3 


3 


-1 


-1 


1 


13 


-1 


-1 


-13 


-15 


5 


9 


-3 


7 


11 


-11 


7 


-11 


-15 


3 


-5 


V 15 


-5 


-9 


3 


15 


-5 


-9 


3 


15 


-5 


-9 


3 


-3 


1 


1 


-V 



matrix of ±1. For L in (2.1) to be a Latin hypercube, we need both B and 
C to be Latin hypercubes. Let us use C = [(1/2, -1/2) T , (-1/2, 1/2) T ] T and 
B = -Bo/2 where -Bo is listed in Table 1. According to Lemma 1, design L in 
(2.1) is then a 32 x 32 Latin hypercube. 

3. Constructing orthogonal Latin hypercubes. We first consider in Sec- 
tion 3.1 the construction of orthogonal Latin hypercubes with run sizes n 
that are multiples of eight. The results here are offered directly by the con- 
struction in (2.1). In Section 3.2, additional techniques are employed for 
constructing orthogonal Latin hypercubes of other run sizes. Results from 
the application of the methods in Sections 3.1 and 3.2 are presented in Sec- 
tion 3.3. 

3.1. Orthogonal Latin hypercubes of n = 8k runs. A design or matrix 
X = (xi, . . . ,x m ) is said to be orthogonal if the inner product of any two 
columns is zero, that is, xjxj = for all i^j. The next result provides a 
set of sufficient conditions for design L in (2.1) to be orthogonal. 

Lemma 2. Design L in (2.1) is orthogonal if: 

(i) A, B, C and D are all orthogonal, and 

(ii) at least one of the two, A T C = and B T D = 0, holds. 

The proof is simple, making use of the following properties of the Kro- 
necker product: 

(3.1) (A (g> B) T = A T (£> B T and {A <g> B) (C <g> D) = (AC) <g> (BD) . 
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Lemma 1 tells how to make L in (2.1) a Latin hypercube whereas Lemma 
2 tells how to make it orthogonal. When the two lemmas are combined, we 
have a way of obtaining orthogonal Latin hypercubes. 

Theorem 1. Let 7 = n^. Then design L in (2.1) is an orthogonal Latin 
hypercube if: 

(i) A and D are orthogonal matrices o/±l; 

(ii) B and C are orthogonal Latin hypercubes; 

(hi) at least one of the two, A T C = and B T D = 0, is true; 
(iv) at least one of the following two conditions is true: 

(a) A and C satisfy that for any i, if p and p' are such that c p i = 

Cp' j . th & ft CLp-i — ? 

(b) B and D satisfy that for any j, if q and q' are such that b q j = 
—bq'j, then d q j = d q >j. 

The role played by A and D is very different from that of B and C in 
Theorem 1. To help understand Theorem 1, one may think that B and C are 
the building material while A and D provide a blueprint for the construction. 
Small orthogonal Latin hypercubes B and C are used to construct a large 
orthogonal Latin hypercube L in Theorem 1. Exactly how the construction is 
accomplished is guided by A and D which are orthogonal matrices of ±1. In 
addition to the right blueprint and building material, a considerable amount 
of care is necessary for the final structure to be right. This is achieved via 
7 = n2 and conditions (hi) and (iv) in Theorem 1. 

Note that A and D may or may not be square matrices, and the or- 
thogonality of A and D is imposed on their columns. In some mathematics 
literature, such matrices are called Hadamard submatrices. For convenience, 
we simply call A or D an orthogonal matrix when its columns are orthog- 
onal. Hadamard matrices and orthogonal arrays with levels ±1 are all such 
orthogonal matrices in our terminology. A Hadamard matrix is a square or- 
thogonal matrix of ±1. An orthogonal array with two levels ±1 requires that 
each of the four combinations (—1,-1), (— 1,+1), (+1,-1) and (+1,+1) oc- 
curs the same number of times in every two columns. For some comprehen- 
sive discussion on these and other topics in the theory of factorial designs, 
we refer to Dey and Mukerjee (1999), Hedayat, Sloane and Stufken (1999) 
and Mukerjee and Wu (2006). 

Because of the orthogonality of A and D, we must have that n± and 
U2 are equal to two or multiples of four. The case where n\ = n-2 = 2 is 
trivial. Consequently, Theorem 1 can be used to construct orthogonal Latin 
hypercubes of n = 8k runs, thereby providing designs that are unavailable 
in Ye (1998) and Steinberg and Lin (2006). When n = n\U2 is a multiple 
of 16, Theorem 1 becomes more powerful. This point will be highlighted in 
Section 3.3. We now revisit Example 1 for an illustration of Theorem 1. 
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Example 2. In Example 1, the first 12 columns of B form a 16-run 
orthogonal Latin hypercube constructed by Steinberg and Lin (2006). If D 
is chosen to be a Hadamard matrix of order 16 in Example 1, Theorem 1 tells 
us the first 12 columns of L in Example 1 constitute a 32 x 12 orthogonal 
Latin hypercube which has one more orthogonal factor than the 32 x 11 
orthogonal Latin hypercube obtained by Cioppa and Lucas (2007). 

When n\ = n%, a stronger result than Theorem 1 can be established, again 
using the properties of the Kronecker product given in (3.1). 

Proposition 1. If n\ =ri2 = tiq and A,B,C,D and 7 are chosen ac- 
cording to Theorem 1, then design (L,U) is an orthogonal Latin hypercube 
with 2?77.im2 factors where L is as in Theorem 1 and U = —uqA^B + C^D. 

We now discuss how to choose A,B,C,D and 7 to construct orthogo- 
nal Latin hypercubes. According Theorem 1, we have that 7 = 712- Matrices 
A and D need to be orthogonal with entries of ±1. As discussed earlier, 
two level orthogonal arrays and Hadamard matrices are all such orthogonal 
matrices. Theorem 1 requires that designs B and C be orthogonal Latin 
hypercubes. All known orthogonal Latin hypercubes from the existing lit- 
erature can be used here. Later in this paper (see Table 3), we obtain a 
collection of small orthogonal Latin hypercubes through a computer search 
for this purpose. So far, all are straightforward. The nontrivial aspect from 
applying Theorem 1 is to satisfy conditions (iii) and (iv) which require that 
A and C (or B and D) jointly have certain properties. In this paper, we 
satisfy these two conditions by choosing A of form A = (Aq, Aq ) t and C of 
form C = (Cq , — Cq) t where Aq and Co are such that all the columns in 
the matrix, 



(3.2) (AC) 



A C 
A -Co 



are mutually orthogonal. In Section 3.3 we provide a method of finding such 
orthogonal matrices with the structure in (3.2) when proving Theorem 3. 
Comments similar to those in this paragraph can also be made regarding 
the application of Proposition 2 in Section 3.2. 

3.2. Orthogonal Latin hypercubes with other run sizes. Consider an or- 
thogonal Latin hypercube of n runs with m > 2 factors. Trivially, run size n 
cannot be two or three. So we must have n > 4. The next result provides a 
complete characterization of the existence of an orthogonal Latin hypercube 
in terms of run size n. 

Theorem 2. There exists an orthogonal Latin hypercube ofn>4 runs 
with more than one factor if and only if n / 4k + 2 for any integer k. 
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The Appendix contains a proof for Theorem 2. Equivalently, Theorem 
2 says that the run size of an orthogonal Latin hypercube has to be odd 
or a multiple of 4. Theorem 1 provides a method for constructing orthogo- 
nal Latin hypercubes of n = 8k runs. The present section examines how to 
construct orthogonal Latin hypercubes of other run sizes. 

The basic idea of our method is quite simple. To obtain an orthogonal 
Latin hypercube, we stack up two orthogonal designs with mutually exclusive 
and exhaustive sets of levels. To make it precise, we use S to denote the set 
of n levels of a Latin hypercube of n runs. Let S = S a L)Sb where S a nSb = (f>, 
and let n a and rib be the numbers of levels in S a and Sb, respectively. Suppose 
that there exist an n a x m orthogonal design D a with levels in S a and an 
rib x m orthogonal design Db with levels in Sb, where for both D a and Db, 
each level appears precisely once within each column. Then 

(3.3) L=(«j) 

is an n x m orthogonal Latin hypercube with n = n a + nb- Note that D a and 
Db themselves are not necessarily Latin hypercubes. 

We consider two special choices for S a and Sb- For easy reference later in 
the paper, we call them two stacking methods. Our first stacking method 
chooses n a and rib such that \n a — n&| = 1 with the corresponding S a = 
{-(n a - 1), -(n a - 3), . . . ,n a - 3, n a - 1} and S b = {-(n b - 1), -{n b - 3), ... , 
rib — 3, rib — !}• This implies that both D a /2 and Db/2 in (3.3) are orthogonal 
Latin hypercubes. We may assume that n a is odd and rib is even in the above. 
By Theorem 2, we know that rib has form 4k. It follows that n a has form 
4k — 1 or 4k + 1. Thus the first stacking method allows orthogonal Latin 
hypercubes of run sizes 8k — 1 and 8k + 1 to be constructed. 

The second stacking method is more generally applicable and it chooses 
S a = {-(n a - l)/2, -(n a - 3)/2, ...,(n a - 3)/2, (n a - l)/2} and 

(3.4) S b = {-(n- l)/2, . . . , -(n„ + l)/2, (n a + l)/2, . . . , (n - l)/2}, 

where n = n a + rib- For this choice, D a is an orthogonal Latin hypercube 
while Db is not. We examine how to construct an orthogonal design Db with 
level set Sb given in (3.4). Now consider the matrices in Table 2. Each of the 
four matrices in Table 2 has the following properties: (i) it has real entries 
dbxi, . . . ,±x n / 2 ; (h) both xi and — X{ occur exactly once in each column; 
(iii) every two columns are orthogonal. We note that the matrices in Table 
2 are related to but different from orthogonal designs in the combinatorics 
literature [Geramita and Seberry (1979)]. 

The matrices in Table 2 can be used to construct orthogonal Latin hy- 
percubes of n runs by setting Xi = (2i — l)/2 for i = 1,. . . ,n/2. They also 
provide a direct construction of orthogonal designs Db with level set S b in 
(3.4) by choosing x^ = (n a + 2i — l)/2 for i = 1, . . . ,rib/2. Most importantly, 
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Table 2 
Four useful matrices 



n 


Z 4 






t 
? 


> 










ID 










Xl X\ 


X2 


Xl 


-X2 


•''4 


X3 


Xl 


-X2 


— X4 


-X3 


-Xg 


x- 


X 5 


xe 


—Xl x 2 


-Xl 


X2 


Xl 


X3 


— X4 


X-2 


Xl 


~X3 


X4 


-X7 


-xg 


-xe 


xr, 


-Xl 


-X2 


X3 


—X4 


-x 2 


-xi 


X3 


—X4 


•<'2 


Xl 


-xe 


-X5 


X7 


-xg 




Xl 


X4 


X3 


-xi 


X2 


X 4 


X3 


Xl 


-X2 


-X5 


xe 


-Xg 


-x 7 






-xi 


■r-2 


—X4 


~X3 


x-, 


-xe 


-Xg 


X7 


X4 


X3 


-xi 


-x 2 






-X2 


-xi 


~X3 


X4 


xe 


x-, 


-XJ 


-xg 


X3 


—X4 


X2 


-Xl 






-X3 


x l 


X2 


•i'l 


X7 


-xg 


Xf> 


-x 5 


X2 


-xi 


-X3 


X4 






— X4 


~X3 


•i'l 


-X2 


xg 


XT 


X 5 


xe 


xi 


X2 


X4 


X3 














-xi 


X2 


X-i 


X3 


xg 


-X7 


-X5 


-xe 














-x 2 


-xi 


X3 


— X4 


x- 


xg 


xe 


-X5 














-X3 


■''4 


-X2 


-xi 


xe 


X5 


-X7 


Xg 














—X4 


~X3 


-xi 


X2 


xr-, 


-xe 


■''8 


X7 














-X5 


XQ 


X8 


-XJ 


—X4 


-X3 


Xl 


X2 














-xe 


-X5 


X7 


Xg 


~X3 


X4 


-X 2 


Xl 














-X7 


Xg 


-xe 


X5 


-x 2 


Xl 


X3 


— X4 














-xg 


~X7 


-X5 


-xe 


-xi 


-x 2 


— X4 


-X3 



they are useful in the following result that allows us to construct D), with 
level set Sb in (3.4) for more general n\,- 

Proposition 2. Let 7=1. Then design L in (2.1) is an orthogonal 
design with level set {— (n a + n — l)/2, . . . , — (n a + l)/2, (n a + l)/2, . . . , (n a + 
n - l)/2} if: 

(i) A and D are orthogonal matrices o/±l; 

(ii) B is an orthogonal Latin hypercube, and C is an orthogonal design 
with level set ±(n a + n 2 )/2, ±{n a + 3n 2 )/2, . . . , ±(n a + {n\ - l)n 2 )/2; 

(iii) at least one of the two, A T C = and B T D = 0, is true; 

(iv) at least one of the following two conditions is true: 

(a) A and C satisfy that for any i, if p and p' are such that c p i = 
Cp'i? then Opi — ^p'i? 

Table 3 

The maximum number m of columns in OLH(n,m) by the algorithm for 4 < n < 21 

n 4 5 7 8 9 11 12 13 15 16 17 19 20 21 
m223457 6 6 6 12 6 6 6 6 
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(b) B and D satisfy that for any j , if q and q' are such that b q j = 
—bq/j, then d q j =d q /j. 

Orthogonality of design L follows from Lemma 2. That L has a desired 
set of levels can easily be established which follows a similar path to that 
for Lemma 1. Comparing Proposition 2 with Theorem 1, we see that the 
only changes are those made to 7 and C. Mathematically, Theorem 1 is a 
special case of Proposition 2 as one can obtain the former from the latter 
by setting n a = 0. We present them separately because they carry different 
messages and serve different purposes in this paper. 

Design C required in Proposition 2 can easily be obtained from the ma- 
trices in Table 2. By letting n = in Proposition 2, design L in Proposition 
2 can then used as our Db as it has desired level set Sb in (3.4). The run 
size rib of such Db has form nb = 8k. Since there is no restriction in the run 
size n a of D a , other than that D a is an orthogonal Latin hypercube, this 
second stacking method allows orthogonal Latin hypercubes of any run size 
n ^ 4k + 2 to be constructed. 

Example 3. In Example 2, if we choose 7 = 1 and let C = (-17/2, 17/2) T , 
Proposition 2 gives an orthogonal design Db of rif, = 32 runs for 12 factors, 
where each column of Db is a permutation of —16, —15, . . . , —1, 1, . . . , 15, 16. 
Now let n a = 1 and D a be a row of zeros. Then stacking up D a and Db gives 
a 33 x 12 orthogonal Latin hypercube. 

3.3. Some results. The methods in Sections 3.1 and 3.2 both build large 
orthogonal Latin hypercubes from small ones. To apply the methods, we 
need to find orthogonal Latin hypercubes with small runs. Various efficient 
algorithms can be helpful in this regard. Lin (2008) reported an algorithm 
adapted from that of Xu (2002). The key idea of the algorithm is to add 
columns sequentially to an existing design. To add a column, two operations, 
pairwise switch and exchange, are used. A pairwise switch switches a pair of 
distinct levels in a column. For a candidate column, the algorithm searches 
for all possible pairwise switches and makes the pairwise switch that achieves 
the best improvement. This search and pairwise switch procedure is repeated 
until an orthogonal Latin hypercube is found. An exchange replaces the 
candidate column by a randomly generated column. The exchange step is 
repeated at most T\ (user-specified) times if no orthogonal Latin hypercube 
is obtained. Since the procedure relies on the initial random columns, the 
entire procedure is repeated T2 times. Apart from the sequential idea, the 
efficiency of the algorithm benefits from its fast updates of orthogonality. An 
update is needed when a pairwise switch is applied. The maximum number 
m of the columns in orthogonal Latin hypercubes of n runs found by the 
algorithm is given in Table 3 for 4 < n < 21 except for n = 16, in which case, 
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our algorithm finds m = 6. The entry m = 12 for n = 16 in Table 3 is due to 
Steinberg and Lin (2006). The detailed design matrices for the orthogonal 
Latin hypercubes in Table 3 are presented in Lin (2008) and also available 
from the authors. 

For a concise presentation of the results in this section, we use OLH(n, m) 
to denote an orthogonal Latin hypercube of n runs for m factors. We now 
present a general result from the application of Theorem 1 in Section 3.1 
and the second stacking method in Section 3.2. 

Theorem 3. Suppose that an OLH(n,m) is available where n is a mul- 
tiple of 4 such that a Hadamard matrix of order n exists. Then we have 
that: 

(i) the following orthogonal Latin hypercubes, an OLH(2n, m), an OLH(4n, 
2m), an OLH(8n,4m) and an OLH(16n, 8m), can all be constructed; 

(ii) all the following orthogonal Latin hypercubes, an OLH(2n + l,m), 
an OLH(4n + 1,2m), an OLH(8n + 1,4m) and an OLH(16n + 1,8m) can 
also be constructed. 

We give a proof for Theorem 3. The proof in fact provides a detailed 
procedure for the actual construction of these orthogonal Latin hypercubes. 
Part (i) of Theorem 3 results from an application of Theorem 1 in Section 3.1. 
In the general construction (2.1), we choose B to be the given OLH(n,m). 
Matrix D is obtained by taking m columns from a Hadamard matrix of 
order n. Design C is chosen to be an orthogonal Latin hypercube derived 
from a matrix in Table 2. Note that each of the four matrices in Table 2 
has a fold-over structure in that it can be written as (X T , —X T ) T . Now let 
A = (S T , S T ) T where S is obtained from X by setting X{ = 1 for all i. With 
the above choices for A, B, C and D, conditions (i), (ii), (iii) and (iv) in 
Theorem 1 are all satisfied. This proves part (i) of Theorem 3. The proof 
for part (ii) of Theorem 3 is similar, involving the second stacking method 
with n a = l and an application of Proposition 2. 

Theorem 3 is a very powerful result. By repeated application of Theo- 
rem 3, one can obtain many infinite series of orthogonal Latin hypercubes. 
For example, starting with an OLH(12,6) from Table 3, we can obtain an 
OLH(192,48) which can be used in turn to construct an OLH(768,96) and 
so on. For another example, an OLH(256, 248) in Steinberg and Lin (2006) 
can be used to construct an OLH(1024, 496), an OLH(4096, 1984) and so on. 

One important problem in the study of orthogonal Latin hypercubes is to 
determine the maximum number m* of factors for an OLH(n,m*) to exist. 
Theorem 2 says that m* = 1 if n is 3 or has form n = 4/c + 2 and that m* > 2 
otherwise. This result is now strengthened below. 
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Proposition 3. The maximum number m* of factors for an orthogonal 
Latin hypercube of n = 16k + j runs has a lower bound given below: 

(i) m* > 6 for all n = 16k + j where k>l and j ^ 2, 6, 10, 14; 

(ii) m* > 7 for n = 16k + 11 where k > 0; 

(iii) m* > 12 for n = 16k, 16k + 1 where k > 2; 

(iv) m* > 24 for n = 32k, 32k + 1 where k > 2; 

(v) m* > 48 for n = 64k, 64k + 1 where k>2. 



Part (i) of Proposition 3 is obtained as follows. By our second stacking 
method with the use of the 16 x 8 matrix in Table 2, we can construct 
an OLH(n + 16, m) where m < 8 if an OLH(n,m) is available. Part (i) of 
Proposition 3 will be true if we can claim that an OLH(n, 6) exists for all 
17 < n < 32 except for n = 18, 22, 26, 30. We already know that the claim 
is true for n = 17, 19,20,21 from Table 3 and for n = 32 from Example 2. 
Note that an OLH(ll, 6) can be obtained by choosing any six columns from 
the OLH(ll, 7) in Table 3. For n = 23, we use the first stacking method by 
choosing n a = 11 and n b = 12 and using an OLH(ll,6) and the OLH(12,6) 
in Table 3. The case re = 24 follows from applying part (i) of Theorem 3 to 
the OLH(12,6) in Table 3. For re = 25, an OLH(25,6) can be constructed 
using the first stacking method with n a = 13 and = 12. For n = 27, we 
apply the second stacking method by choosing n a = 11 and = 16. The 
second stacking method also allows the construction of an OLH(28, 6), an 
OLH(29,6) and an OLH(31,6). We choose n a = 12 and n b = 16 for n = 28, 
n a = 13 and n b = 16 for n = 29, and n a = 15 and nj, = 16 for n = 31. Part 
(ii) follows from the existence of an OLH(ll,7) in Table 3. Parts (iii), (iv) 
and (v) follows from an application of Theorem 3. 

The following remarks are in order regarding Proposition 3. If we wish, we 
can obtain sharper lower bounds on rre* for certain values of n by applying 
Theorem 3. For example, using the OLH(12,6) in Table 3, we can establish 
that m* > 6 x 8 fc for re = 12 x 16 fc . We will not dwell further on this issue but 
are satisfied with the general lower bound in Proposition 3. The lower bound 
in Proposition 3 is derived from the small orthogonal Latin hypercubes found 
by our algorithm. Therefore, improved bounds will be naturally available in 
the future if better results are obtained from computer search. 

Lin (2008) in her thesis provides a comprehensive table of orthogonal 
Latin hypercubes for all n < 256. Here we present the results in Table 4 
for the case where n is a multiple of 16. The first column is the run size 
and the second column is the number of factors obtained by our methods. 
Those entries marked with an * are given by Proposition 1. The remaining 
columns of Table 4 give the number of factors obtained by the methods of 
Ye (1998), Steinberg and Lin (2006) and Cioppa and Lucas (2007). Table 
4 clearly shows that our methods can provide orthogonal Latin hypercubes 
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when other methods cannot be applied. When other methods are applicable, 
our methods give many more factors than these existing methods with the 
only exception given by n = 256, for which case Steinberg and Lin (2006) 
found an OLH(256, 248). 

4. Nearly orthogonal Latin hypercubes. The general construction in (2.1) 
is very versatile and can also be used to construct nearly orthogonal and cas- 
cading Latin hypercubes. Due to space limitation, we omit the discussion 
on cascading Latin hypercubes and refer the reader to Lin (2008). In what 
follows, we provide a brief discussion on nearly orthogonal Latin hypercubes; 
interested readers can find more details in Lin's thesis (2008). 

To assess near orthogonality, we adopt two measures defined in Bingham, 
Sitter and Tang (2009). For a design D = (d±, . . . , d m ), where dj is the jth 
column of D, define Pij(D) to be dj dj /[dj didj dj] 1 / 2 . If the mean of the 
level settings in dj for all j = 1, . . . ,m is zero, then Pij(D) is simply the cor- 
relation coefficient between columns di and dj. Near orthogonality can be 
measured by the maximum correlation pm(D) = maxjj \pij(D)\ and the av- 
erage squared correlation p 2 (D) = J2i<j Pij(^)/[( m ( rn ~ Smaller val- 
ues of pm(D) and p 2 (D) imply near orthogonality. Obviously, if pm(D) = 
or p 2 (D) = 0, then an orthogonal Latin hypercube is obtained. The follow- 



Table 4 

Orthogonal Latin hypercubes of n — 16k runs where k>2 



n 


rn 


Ye 


SL 


CL 


32 


12 


8 





11 


48 


12 











64 


32* 


10 





16 


80 


12 











96 


24 











112 


12 











128 


48 


12 





22 


144 


24* 











160 


24 











176 


12 











192 


48 











208 


12 











224 


24 











240 


12 











256 


192* 


14 


248 


29 



Note: Ye: the number of orthogonal columns by Ye (1998); 
SL: the number of orthogonal columns by Steinberg and Lin 
(2006); CL: the number of orthogonal columns by Cioppa and 
Lucas (2007). 
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Table 5 

Design matrix of Bq in Example 4 



/-15 


15 


-13 


13 


-5 


-13 


5 


3 


-1 


5 


-7 


5 


-9 


-9 


5 \ 


-13 


-15 


-3 


3 


7 


3 


15 


-11 


13 


-5 


7 


-13 


-7 


-3 


-3 


-11 


-9 


-5 


-11 


-15 


13 


-5 


11 


-9 


9 


9 


3 


-5 


-1 


-11 


-9 


-1 


9 


-15 


-11 


1 


-1 


-13 


5 


-1 


-15 


7 


1 


3 


15 


-7 


1 


-7 


7 


15 


15 


-13 


9 


-5 


-13 


-3 


-1 


-1 


7 


13 


-5 


13 


11 


-5 


9 


-7 


-3 


-9 


-13 


11 


13 


-9 


-3 


13 


1 


-3 


-5 


13 


15 


-9 


-9 


-11 


1 


7 


-9 


15 


11 


9 


1 


-1 


-1 


-11 


3 


-7 


11 


-15 


13 


15 


-7 


-3 


-9 


9 


7 


9 


-5 


1 


3 


-9 


-3 


-1 


-5 


-15 


-1 


11 


3 


-11 


-15 


15 


5 


-15 


3 


-3 


15 


11 


3 


9 


1 


-7 


-15 


1 


-13 


-3 


3 


-15 


-9 


5 


9 


7 


-1 


5 


11 


9 


13 


15 


15 


5 


1 


11 


-7 


9 


7 


7 


-1 


-13 


13 


-1 


-7 


-5 


9 


-7 


3 


15 


-13 


-11 


-13 


9 


5 


-11 


-9 


-7 


-3 


7 


-3 


-11 


-15 


11 


-7 


13 


-13 


7 


11 


11 


5 


5 


-13 


7 


11 


5 


3 


-11 


-5 


-5 


-11 


15 


-7 


13 


-7 


-15 


9 


1 


5 


3 


-15 


-3 


13 


1 


13 


5 


11 


3 


V 15 


-13 


1 


1 


-3 


-11 


-9 


7 


1 


7 


-1 


-11 


-15 


-5 


11/ 



ing result shows how the method in (2.1) can be used to construct nearly 
orthogonal Latin hypercubes. 

Proposition 4. Suppose that A, B, C, D and 7 in (2.1) are chosen 
according to Lemma 1 so that design L in (2.1) is a Latin hypercube. In 
addition, we assume that A and D are orthogonal and that at least one of 
the two, A T C = and B T D = 0, holds true. We then have that: 

(i) p 2 (L) = w 1 p 2 (B) + w 2 p 2 (C); 

(ii) pm(L) = M&x{w 3 pm(B),W4 P m(C)}, 

where w\, w 2 , u>3 and W4 are given by w\ = (771,2 — l)( n 2 ~~ l) 2 /[( m i m 2 — 
1)(?7 2 - l) 2 ], w 2 = n\(m x - \){n\ - l) 2 /[( mi m 2 - l)(n 2 - l) 2 ], w 3 = (n 2 - 
l)/(n 2 -l) and W4 = n 2 (n\ — l)/(n 2 — 1). 

The proof for Proposition 4 is in the Appendix. Proposition 4 says that if 
B and C are nearly orthogonal, the resulting Latin hypercube L is also nearly 
orthogonal. An example, illustrating the use of this result, is considered 
below. 

Example 4. Let A = (1,1) T , C = (l/2,-l/2) T , and 7 = 16. Choose 
a 16 x 15 nearly orthogonal Latin hypercube B = Bq/2 where Bq is dis- 
played in Table 5, and B has p 2 (B) = 0.0003 and p M {B) = 0.0765. Tak- 
ing any 15 columns of a Hadamard matrix of order 16 to be D and then 
applying (2.1), we obtain a Latin hypercube L of 32 runs and 15 fac- 
tors. As p 2 (C) = p M (C) = 0, we have p 2 (L) = [n\ - l) 2 p 2 (B)/(n 2 - l) 2 = 
0.0621p 2 (B) = 0.00002 and p M (L) = (n 2 2 -l)p M (B) / {n 2 -I) = 0.2493p M (B) = 
0.0191. 
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A more general result than Proposition 4 can be obtained if A and D 
are nearly orthogonal and at least one of the two, A T C = and B T D = 
0, approximately holds. However, besides being very complicated, such a 
general result does not greatly enhance our capability of constructing nearly 
orthogonal Latin hypercubes as the orthogonality of A and D and that 
between A and C is much easier to achieve than the orthogonality of B and 
C . Our result as in Proposition 4 makes a more focused presentation. Lin 
(2008) also contains a table of small, nearly orthogonal Latin hypercubes, 
based on which we can construct large nearly orthogonal Latin hypercubes 
via Proposition 4. 

5. Concluding remarks. We have presented a general method of con- 
struction for orthogonal, nearly orthogonal and cascading Latin hypercubes. 
The method uses small designs to build large designs. It turns out that some 
appealing properties in small designs can be carried over to large designs. 
We have also obtained a result on the existence of orthogonal Latin hyper- 
cubes. The power of the general method is further enhanced by the methods 
of stacking. Although our methods are motivated by computer experiments, 
they are potentially useful for constructing other designs such as permuta- 
tion arrays which are widely applied to data transmission over power lines 
[see Colbourn, Kl0ve and Ling (2004) and the reference therein]. 

Many researchers are increasingly interested in using polynomial mod- 
els for computer experiments though Gaussian process models are still very 
popular. Polynomials are attractive because they allow gradual building of 
a suitable model by starting with simple linear terms and then gradually 
introducing higher-order terms. Orthogonal and nearly orthogonal Latin 
hypercubes are directly useful when polynomial models are considered. If 
one insists on using Gaussian-process models, orthogonality and near or- 
thogonality can be viewed as stepping stones to space-filling designs. This 
is because a good space-filling design must be orthogonal or nearly so as 
the design points when projected on to two dimensions should be uniformly 
scattered. Thus the search for space-filling designs can be restricted to or- 
thogonal and nearly orthogonal designs instead of all designs. A rich class 
of orthogonal and nearly orthogonal Latin hypercubes can be obtained by 
considering a generalization of the construction method in this paper. The 
generalization makes use of an idea in Bingham, Sitter and Tang (2009) [for 
more details, we refer to Lin (2008)]. It is part of our research plan to write 
a paper on this topic in the future. 

APPENDIX 

Proof of Lemma 1. We provide a proof under (a) in condition (ii) of 
Lemma 1. The proof is essentially the same if condition (b) is met. For design 
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L in (2.1) to be a Latin hypercube, we need to show that each column of 
L is a permutation of — (n — l)/2, — (n — 3)/2, . . . , (n — 3)/2, (n — l)/2 where 
n = n\U2- Without loss of generality, we will prove that this is the case 
for the first column of design L. For ease in notation, let (a\, . . . ,a ni ) T , 
(61, ... , b n2 ) T , (ci, . . . , c ni ) T and (di, . . . , d n , 2 ) T be the first columns of A, .B, 
C and -D, respectively. Then the entries of the first column of L are given 
by 

(A.l) ciibj + n2Cidj where i = l,...,n\ and j = 1, . . . , 77,2. 

As C is a Latin hypercube, we have that ci,...,c ni are a permutation of 
— (rti — l)/2, — (774 — 3)/2, . . . , (ni — 3)/2, (ni — l)/2. For any given odd ?j such 
that 1 < u < n±, consider the two distinct levels, — {n\ — u)/2 and {n\ — u)/2, 
of C. (The two levels may be the same level when n\ is odd. This simple 
case will be dealt with later.) For this given u, let i and i' be the unique 
indices such that q = (rei — u)/2 and Cj' = — (ni — u)/2. As (i,- = ±1, the two 
numbers Cidj and Ci'dj must always have opposite signs and thus always 
give the two points — (n\ — u)/2 and {n\ — u)/2 on the real line. Therefore, 
the two numbers n^Cidj and U2Ci>dj always give the two points —772(77-1 — 
u)/2 and 712(721 — u)/2 for any j = 1, .. .,ri2- By condition (a), we have that 
cij = Oj/. Since B is a Latin hypercube of n,2 runs, we have that 61, ... , b n2 
are a permutation of — (ri2 — l)/2, — (ri2 — 3)/2, . . . , (712 — 3)/2, (ri2 — l)/2. 
As <ij = ±1, we have that Oi&i, . . . ,dib n2 are also a permutation of — (ri2 — 
l)/2, — (ri2 — 3)/2, . . . , (ri2 — 3)/2, (ri2 — l)/2. Since aj/ = a^, this shows that 
the 2ri2 points given by aibj + ri2Cidj and aj/ftj + U2Ci'dj for j = 1, . . . , 722 can 
be divided into two sets of n-2 points with the first set of ri2 points given by 
—77,2(^1 — u)/2 + bj for j = 1, . . . ,712 and the second set of n,2 points given 
by ^2(^1 — u)/2 + bj for j = 1, ... ,122- The 712 points —n,2(ni — u)/2 + 6j for 
j = 1, ... ,n2 are centered at —712(^1 — "u)/2, and equally spaced with two 
adjacent points separated by an interval of length one. A similar remark can 
be made about the other set of ri2 points. We note that if u = ri\ when n\ 
is odd, for the unique i with q = 0, the 77-2 numbers a^bj + n,2Cidj = a^bj for 
j = 1, ... ,ri2 are simply the set of bjS for j = 1, . . . , 77.2. By allowing the odd 
u to vary in the range 1 < u < ni, we see that the ni?i2 numbers in (A.l) 
are precisely these n points, — (n — l)/2, — (n — 3)/2, . . . , (n — 3)/2, (n — l)/2, 
where n = rt\n2- The proof is complete. □ 

Proof of Theorem 2. The sufficiency part of Theorem 2 can be 
proved directly which involves the construction of an orthogonal Latin hy- 
percube of n runs with m > 2 factors for any n that does not have form 
4/c + 2. We omit this part of the proof as the existence result also follows 
from Proposition 3 in Section 3.3 when we establish a lower bound on the 
maximum number of factors in an orthogonal Latin hypercube. 
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It remains to show that there does not exist an orthogonal Latin hyper- 
cube of n = 4k + 2 runs with m > 2 factors. Now suppose that such an orthog- 
onal Latin hypercube exists, and let a = (a±, . . . , a n ) T and b = (pi, . . . , b n ) T 
be its two columns. Then we have that both a and b are permutations of 
{1/2,3/2,... ,(n - l)/2,-l/2,-3/2,...,-(n - l)/2}. Note that ££=i <n = 
0, Y^=i h = 0- Without loss of generality, we assume that a = (1/2,3/2, 
. . . , (n — l)/2, —1/2, —3/2, . . . , — (n — 1)/2) T . In other words, we have Oj = 
— = (2i — l)/2. Since a and 6 are orthogonal, we have that YH=i a A = 

2- 1 E^iK 2 ^ ~ ( 2 b i+ n/2){i ~ 1)] = 0. Note that both 2bi and 2b i+n/2 are 
odd, i = l,...,n/2. The quantity (2bi)i — (2b i+n / 2 )(i — 1) must be odd as 
(2bi)i and (2b i+n ^)(i — 1) cannot be both even or both odd. In addition, 
n/2 must be odd. It is obvious that the addition or subtraction among an 
odd number of odd integers gives an odd integer. This leads to a contradic- 
tion. □ 

Proof of Proposition 4. Parts (i) and (ii) can be obtained by noting 
that 

L T L = {A®B + ~iC® D) T (A ®B + jC(g)D) 

= (A T A) ® (B T B) + -f(A T C) (8) {B T D) 

+ -f(C T A) ® (D T B) + 7 2 (C T C) ® (D T D) 

= ml mi ® (5 T S) + n^(C T C) 8) (n 2 / m2 ), 

where / mi and I m2 are identity matrices of size mi and rn-2, respectively. 
The second step follows by the properties of the Kronecker product given 
in (3.1). The last step is due to the orthogonality of A and D, either of the 
conditions A T C = and B T D = 0, and 7 = n 2 - In addition, for an n x m 
Latin hypercube L, the sum of squares of the elements in each of its columns 
is ?i(n 2 -l)/12. Thus the mxm correlation matrix among the m columns of 
L is given by [n(n 2 — 1)/12] _1 L T L. Based on the elements in the correlation 
matrix, p 2 (L) and pm(L) can be computed in the following way: 

p 2 (L) = (mm 2 m 2 (m 2 - l)[n 2 (n 2 - l)/12] 2 p 2 (B) 

+ n 6 2 m 2 m 1 (m 1 - l)[m(n? - 1)/12]V(C)) 

x (m\m 2 (m\m 2 — l)[n(n 2 — 1)/12] 2 ) -1 

_ (ma ~ l)(nj - l) 2 p 2 {B) + r4(mi - l)(n 2 - l) 2 p 2 (C) 
(rrt\m 2 — l)(n 2 — l) 2 

and p m (L) is the larger value between n\n 2 [(n 2 — 1) / '12] pm(B) /[n(n 2 — 
1)/12] and n|ni[(n 2 - l)/12]p A/ (C)/[n(n 2 - 1)/12]. With the definition of 
«;i , u; 2 , W3 and , we complete the proof. □ 
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